^ MpdjiUor Purfomanct of Opto^lpop Hichil— 


by 

T. B. StMridan 

OepartMnr of Hachanieal EngiOMrlag 
HaaaachyMcea InstiCue# of Todmology 
CiMbridgo, Hooaoehuoocto 02X39 


dbocroce 

A tochnlquo U proooncod for sodoling tho porfoiMoeo of 
op«a-Xoop M«rhaoiM» or oyoc«M, vhoro porfonuttco io aoMorod 
bp oueoMo or foiluro m a functioo of cho aaXaotod eargot for 
oovmne along a eonacrainod erajoceorp aod viehout oorraefiva 
feadback. A oodlflcatlon of atgaaX dacaction chaorp la uaadt 
vhich ttonMliaaa diaaiaiXat data and indieacaa two indapandant 
parasMtera of parfonuaea; (I) '*dUerlalfiabiUcp** «id (2) 
''optlMlUp'* of tha JlatributiM of aalacead aovaa. An llluatra- 
tlva application la aada to axparinancal data. 



Nrs i0ia4 

lotrodMcclow ^ 

Tha control of nachanlana for parfomiag eonpXax ao4|wantial taalca 
auoh aa natariaXa precaaoiag# aaaaitblp and inapaetlon of Mnafaetarad 
parta* aaroapaea vahlelaa and othar oonplax proeaaaaa can ofcan ha 
char^acariaad aa a •nXtllavaX prDcaaa« aa Indioatad la Fig. X. At tha 
Xwaat XavaX (tha laoar Xot*p ) poaltlon and foraa varlahXaa of tha 
•aehanlan nap bo naaaurod <’^tlawoaalp or at froqMant Intarvala in tlna 
or apaea (a), than oporatod upon to drlva rha naohanian (a') Into 
contiiiuoua eonfoinatian with a rafaraaea Input (6). Tha oontroXlar at 
thla XavaX la tpplamlXp d paaalva aXaetronle or naohanieaX flXtor or a 
eonputar-baaad aarvoaontteXXar. 

At an Intamadlata Xaval <niddXa loap) a atorad progran eonputar la 
tppieaXXp tiaad to naaaura poaltlcn or ferea varlabXaa (h) of OAtamaX 
objaeta with raapaat to tha naehmlas. 90r ananpia thaao nap ba 'aatlXa 
aonaora or ainpXa optical ranging or pattam racognlelcn davicaa. Thaaa 
data art aanpXad at Xaaa f raguant intarvaXa than thona at (a) • and aarva 
togathar with coananda fron tha hunan auparviaer <c*)| aa Inputa to a 
eonputar progran which ganaraeaa a eh«iglng rafaranea Input to tha Xawar 
loop (b'). 

At tha highaat laval (outar loop) tha hunan aupatviaor obaarwaa with 
hia own apaa diraatXp» or indiroeeXp through aiding Inatrunanta auah aa 
taXaulaion, tha ralaticn of varioua objocta in tha anvlronnant (c) « 
Including tha nachanlaot to aach othar. Ha acta upon thla information » 
pXua hla aprlorl goaXa or crltaria» to conn an d or contUmMlly raprogran 
tha eonputar cantroXlar* Tha nan*a obaarvatiana (c) and niwaiida to tha 
eomputar <c0 ara at Xaaa fraquant intarvala thm tha eonputar 'a naaaura* 
nanta <b ) «d rafaranoa input ehangaa (b')« which in turn ara at Xaaa 
fraquant IntarvaXa than tha laadbach (a) IntarvaX to tha naahmian md 
tha firat XavaX eantraX aigaal (a')« 

A diffarant prohlan in tha anginaaring aueh naahaniana or man-maahiaa 
apatama la to avaXuaca parfarmanea^ tapaelnXXp with ragard to tha 
Inportanoa of facdback at vafi/>*«a XavaXa aa a ftaictlen of aarpllng 
troquanep* In affact* a coipreniaa muat ba found which noat appreprlataXp 
tradaa errora againat iarpling fraquaney of varioua loop#* and pamita 
nodal ing a variaty of nyatana with taw parnMtara in atandardlaad fom. 
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to vpto^ u .«ga*.t .4 yhi«h cioMir NMitoi.* th« thtotr of 

a»6») oppli.4 otvMl dotwttoo thoonf to btaoty J«do«««t 

of o, to «Kor Oktu took,. Hot, - toMlf, tho tl^oty 

olloo for OBltl or cmttooooo lovol okplloU roopoMO toeloloo obiob 
toooJt. to .«oo^ or fottot. o„ ooto *<, «. o.,^* othor eh*,.. 

to Mko • thoory do.t(M 4 for Mdoltog oonoory ptoeooooo ooitoblo for 
aoter grocMMt, 

tjrpieoUy o eooploto cook to opoclftod oltbor oo o eooetooooo tro- 
joetory or oo o ooqooaeo of dootrod dloeroto otocoo to bo ototovod. olcb 
eooocrototot otodlttoto o. f«,«ti«« of pooltloo. ctoo ood .oorir. to 
•ooy eoooo tt to eoovontont to eboroetorloo porfoimoooo ot ony yotit to 
ttoo by obochor tt to vlthto o toUroaeo roofo (obleh mv bo o to-fo tog 
foaetteo of pootttOD ctoo or oaornr vorttoloo) or ohoebor It to oototdo 
tMo rongo. ««. 2 obooo oebowttcoUy too cooko. ono doftood coottoMOooXy, 
tbo othor doftood 00 o oo<|u«.co of dtoeroco ooooco. both ottb eboostog 
totortoco. ntttbto ' tbto rongo ...n. thot no otgntftoon. yonoitto. .to 
toeorrod ond oitb wiottto oooo It co„ b. brought undor donctol omo 
tho loop to cloood. •to.totdo" cbto r«>go to*, .hot tho pooolty to 
•t|P.lttc«t «»d thot brtogtog tbo oyoto. «dor c«,ttol toto. to*.rttog 
to on oborr «oto. o ehongo to nortol pl«. . rotorn to on oorltor port 
o to' ,onco. otc. For oxo^to o Mtpolotor night oeetdontoUy drop 
to . it ooo eorcytog. or confront on <oMxpoccod obotoolo to tco 
p toaod potb. or find itoolf to o ktoonotte otogaloricy or "gtabM look", 

A vohicto night run off tho rood or eolltdo uith on obocodlo. Tbuo tbo 
•botp nooltooority to ponolt, o. o f«cti«i «f „„o„g porfomonto 
rortobloo to ehoroetoriocic or voriouo tool cooko. 

)h •" concomod choro uUh bon for .long tho gi««, conttouou. poch 
or oogoonco of dtoer.ro .to... of tbo took tho noebtoio. to op«i 
loop fwMiton, t.o,, bofow tho uiffownc. botvoon oetuol «d dooirad 
otto., to ..oourto tod corroctiy. offort. on topoood. to utu toouno 
thto th. itogor tbo opto loop now tho gwto.r tho took of «!»„. o 
otowtonie roltoien. to otoh to doyolop bosj, o doocripti*. nodol (tbo 
ocociotteol dooerlptieo of topirlcol no*.., both cb. ontooc of tbo no«.o 
tod ubothor tho, ouecdod or f.ilod) gsi o nornocto. «Ml.t (. opocifl- 
eotion of tom. th. foodb.ek loop ohould b. etoood to ntotoit. .opoet^l 
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ptMlcy}* 

aiLlteftt 

iMt n thm r#49iMi«t«d) for m ogM moim at mm 

givM potet (aWp or c> in CM tyrtoai of Fig. 1. If ot a » b or e cMc 
Mwa ia obMfvad to ba (or feava boon dariag CM «ova) oataida cM 
toUfabla raagat m call ie a faUarap f. OcMmIm U U a aoeeaaap a. 

Ma ahali aaM a plot of CM probablUcy daaaiCF of MUetliig p<») aad 
eba Joiat prabidiitiCF daaaltF of Mlaatiag a ^ oMorviag y to bo a failura 

AaoMpsiaiia ataead abova iap^F tMt aapaF<MitaL plot# of cMaa 
qaaatUiaa «iU bo approaiMtaiy of CM foew ahoim ia Fig. 9; CM ratio p(ipf) 
CO p6^ iaacaaaaa with a# aiaaa tho graatar a cM aora CM oaMilativa riako 
tM joiat probability daaaitp of aalaatiag a aad aaaooo^iag la oboioMly 
tho difforaaaa batvaaa tM tM daaaitiaop 

p(apa) • p(a)-p(a»f>. (1> 

by bayaa* thaevaa tM eMtiagaat probidiUltla# of a givaa f or a ata 




Ma dafiaa ataKOativa prahabUity fMatioaa« i*a«p tha ptabibllity of a 
aalactiaa iaaa tbaa of ogaal to a« 

H»\t) • f p(a|f)da (g) 


FCaja) • J p(a||i)da 
4 ^ 
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If a oroaa plot is Mdo of P(x|f) ond F(ij«) M to Fig* 4» • rough 
equivalent of the receiver operating eharaeterietle (ROC) of algnnl 
detection theory reeelte* Though ectuaUy It le e dletributlen of notor 
reaponeee, we ohell cell our curve an ROC. Thla creaoplot aarvea to 
nonallae and atandardlaa the open loop parfotMica eharaetarlatlr ao that 
two independent peraMtere of perfomence are readily apparent* Faloea 
of X are acaled eonotonieaily along the eroeaplee curve. 

The flrat paraaatar of Intareat la a naaaure of ''relative diaerl- 
nlnation" between auceeea and failure for the particular dletributlen 
of X valuea aelectad. It la the tendency of the experlMRital curve tovard 
that ROC "curve" which iateraecta the upper left hand comer* At thia 
point P(x|a) - 1 and P(slf) *0; therefore it ia a point of par feet 
dlaerlnlnatlon, where leaaer valuea of x proniae the fullaat poaaibla 
aueceaa with no riak of Cailure, and greater valuea of s can only be 
failures. Xn practice thla altuatlon la aaldoe If aver present « alnca 
selecting the greatest x which can be successful usually eaaas a slgnl* 
f leant probability of failure. Thla is charaetarlaad by an Intareadlata 
curve 1 or 2. Diagonal line 0 la Share at each x In the distribution 
P(xle> • P(xlf). A curve below the diagonal inpllas a situation where one 
oust experience nuch failure at sealler values of x to finally attain 
eons aueeessea at greater values. This Is contrary to our eonotonieaily 
Increasing risk asaiootlon and thus la a situation va aasuna to be 
Irrelevant for the present* 

The second paraneter of Intareat la the central tendency of p(x) 
relative to the optlnal x. The optlaMl x is ealculatad fron knowladia 
of the tendency to failure as a ftnctlon of x (aa eacinated fre« the 
experlnental data), plus the given rewards R(x) for novlng as far as x 
auccesafully and the given cost C(x) for failure. Thus the expected 
value of return E^) over a distribution of novas Is 


E(6<x)) 



r(x.a)R(x)dx 



• f)'*(x)dx 


( 6 ) 


However, If it were possible to select consistently a single value of x. 
o'i ould naxlnlse expected value of return by choosing 


opt 


■axltCx)] • nax (ptalx) R(x) - p(f|x)C(x)] 


(7) 


'445 


5 


Ths tsndsncy towsrd ths upper left hand eorosr *s the degree of 
non-overlap of ths pu|i) md p(x|f) distributions. With a given eenotmic 
propansUy to fail m a function of x. ths psresntsgs overlap of the two 
distributions cm be rsducsd by sslsotini over a larger rmgs of x vsluss, 
insuriag suossss at anall x and failure at large x. During losmingt 
sttdi a oaUotiOB over a large rmga of x ia a good aeratogy to ootrhliah 
txporinantally tho dopandanao of p(x|a) and p(x|f) on x* At lator atagoo 
prasMbly the bunan or oonputor dociaion tMkar attanpta to narrow tho 
tmpk of X an a region of noar optiMl payoff, ifocoaaarily over any 
narrow range of x p<x|a) and pU|f) dtatributlona will cease to be diaplacad 
r*l*tiv* to **ch oth*r «n eh* x axl* md th* ROC e»rm wlU *|>pre*eh th* dl»*OB*l. 

there are various naans of sealing the tendency to the upper left 
hmd corner, (too nathod used In signal dataetlon thaeiy ia to aatleata 
fron the data the diatanaa d* batwaen naans of diatributiona p(x|a) 
md p(x|f) divided by the eaan standard daviacion. FOr two Cauaoian 
diatributiona of equal varimea this proeadura raoulta ir. curves for 
d' • 1 and d' • 2 aa indicated in Fig* 4. 

Since the slops of the ROC curve 
d p(x|o)dx 

"> 

d p(x|f)dx 
^0 


and thus for any given x in a diatrlbutloi 



Froe thia one eight assart that if a alagla value of x wore chooen 
conaiatantly the rutum ueuld appiexinato^ 


(9) 


^ (x) w (alepu of R0C)p(a)R(x) - p(OC(x) . (10) 

x^^ can ba found by trial and arror by usa of equation 10* Hiaautna of 
tS central tandaney of x are the avaraga x or, aUamatlvaly, the eadian 
X. The dlffaranea battfsan md x^^, if tha data warrmt a unique 
•paelfleatlcn of tha latter^ can than ba apaelflad. Whan operating ovnr 
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a narrow range of % where p(x,a) and p(x,f) are conecmt and the ROC haa 

unity elope, (10) reducee to the condition for x that 

opt 

(R(x) • Cconatant)R(x) - (eonetant)C(x) Ul) 

and the choice of x depende only on the relative oaipiitude and nonlinearity 
of R and C. The difference between and ^ neaeura of 

coneervatian < * jpt^ ^*aed * *opt^ independent of the degree 

of diacrlflUnaoility * 

Bxaaele of Application to Bxoerinental Data 

In order to illuetrate the net hod^ data were taken fron two hmm 
eubjecte perforaing a eiople open loop aanipulation teak which correeponde 
to the firat teak of fig. 2, but with fixed toleranea* FPr eonvanianea 
the '\Mchaniae*’ eeployed waa a h\Mn are and hand holding a aiepla pan. 

In thia teak a aubjact obaervad the teak, than with ayaa cloaad eovad the 
pan froe a atarting point toward tha right, trying to heap tha pan within 
two linea apacad 0.2 Inchea apart. The payoff or return fgeetion (A) 
waa 

^ MCCM. *<”lf f.11 • » *" 

The aubjecta were explained the return function and inatructad to aggtegata 
the greateat aoore poiaible. Bach aubjact had 41 “learning” triala, than 
164 “teat** triala. Or all triala ha could obaarvo what happaaad on tha 
laat trial before goiag on to tha next. Tha tanporal pace waa aalf* 
datereinad. 

Bxparieantal data for the taat triala are plotted in tha fore of 
hlacograata, for eoveeant * in 0,2 inch tncreeanta, in Pig. 5. Note tha 
big diffarenca betweae aubjacta, awbjact GP being conaarvative with aeall 
X aid anall p(f). 8«i ject P8 riaka larga x and large p(f). 

Pig. 6 ahowa the ROC eurvea approxinated fron the teat data of Pig. 
i. Pig. 7 ahowa the ROC curve drawn for the learning triala of one 
aubjact derived by an alternative aehane, nanely tha point by point plot 
of aequential valuee of x. Notice that aa predicted the tendency to 
generate diecrlainabilicy (d*) la graatar for the learning triala th«i 


7 

for tha taat trlala. Thia ia ba t a w aa both Obaolota range mO varidbility 
waft grantor thgg far tha tgat trlala. Notira aapaoiaily that both 
auhjoota* data roanit finally ia appienisataly tha aasa iOC cu r vaa 
(Pig. 6) avto though tha row biotograna ware qnita different. Plaally 
notice that the nadian raapcnaaa of both eObJocta, Ua in a rag ion of tho 
ROC whora R(x) and alopo onltiply to keep R<x) relatively canataat. Thia 
lack of a aharply defined optiaua charactariaaa many taaka. 

la daaigaing and aontrellni naabMiaBa for Bnltidagma of free den 
taaka it ia iJ^wrtant to ovaluoto porfoimnaao of opon loop Bovao. If 
each of n aat of raaponaaa, iatandad for opaa loop Bovanent of extant x, 
can be charaatarlaad by obanrvatian in»e binary parfocBanoa catagorlaa of 
aucoaaa and failnra, aid if a given mtura fmictian apaeiflaa cnwnrda for 
auooooofnl bowo to x and eoat for fnilnro at or bafera x, and if proba- 
bility of failure iacraaaaa Bonotonieally with x, than a parfofBBtee 
Bodal aaniogoua to tha racaivar operating oharactariatic <R0C) of aignal 
ditoetion thoory io ooofnl. 

A cteaa plot of euBiilativa prabtfiilitioi of x, given aneoaaa, and of 
X, givtn failure, ravaala two indapandant parfotBmea pariaatara. Tha 
firat paraBOtar ia tha **ralativa diaeriBinability" of tho oot of aovao, 
tho dogmo to whiob aovoa of oxtont looa than aoBo value are auraly 
aucaaaaaa Ad aovaa graatar than eoae value are aurnly failuina. Thia 
index ia inaraaead m tha rAga of x of tha aat of Bovaa iaataaaaa, and 
it ia dacAAod by randOB *Hieiaa” or AOMtAlUbilUy ia tho MehAim. 

Tho oooond pornnotor io tho cMtral tAdAoy of MlAtiag or 
targoting i, raUclva to tho optiBol, a dottraiiiod ftm tho givA 
rotuA fwatlA Ad tho onpirieally dOBAOtrAad pcobAilitiM of aurAaa 
Ad fallnA A a fAOtlA of x. It ia directly a mmun of riok va 
coaaarvatira in Miacting or torgating bova. 

A applioAlA to data for opA loop oa BovoBAta by tA hwaan 
aubjaota illAtrAaa how rather diaatailar diatributlAi yield alBilar 
ROC plate. Rewavar, the data did oot prowiA auffiolAtly aharp dafiaitiA 
of tho "optiBoi” Bovo diatAco to AArt thA tha cAtral tAdAoiaa tAdad 
tAord flak or cAoervAiA, 

Purthar AAlopBont of tho Aolyaio Ad ito applicAlA an ia order. 
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f^gyaa 1» 

Naaipulacor uUh eolti^laoai eaatroi 



^0 — oC) — co* 0 ‘”'Ot" 

OHH tOM M«Mt PWTANCI ^ 


s*«MCi« «t em «fM Imv ^ *• 

>•« ua, wttbtt beilidartM. a|>,*r twfc U a ea*ctmoaa MvaaaMi 
tba IcMr taak ia a aaqaaaaa a! dlaeiata aawa a ta. 
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Fiftin 3. 

Topical plots of p(s>» p(s»s), p(s»l). Ths loft hm4 plots copfossnt s csss of 
rslstlvslp blfb disevlaloibllitp . TIm riphc bssd plots rsprsssnt s csss of l<w 
diseriaiiisbiUtp. so adibc oocuf sftsr s eostrol systsa ssttlsd dwn in in 
oporstlas tasgs nosr tlis asdiss of p(s) of ths loft haid distflbsCios. 


(suaesssss) 


Sdbiset Of 


(fsllttiss) 


(stiessssss) 


Sybjset P8 





BistotvM of dots for too hmm sub joe ts porfotalat eostiaaoas opsn loop 
•la mgymonto vithla a 0^2 iaifi vida t sis rases ■ana ^ra cha catara 
feastioa • (x ia«liaa)|f aaaeaad"^^^lf fail* 
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Figure 6. 

ROC type eroMplots ot the teat data of Fig, 5* Hcdlao valuaa are ladieated 
for each aabject aeparately. In each caae the use of equation 10 proven 
Che *'optloMl** to be a releCively broad region* not epecifioble froo 
empirical data as a point, but soBMuhere near the aediana of the dletributiona, 
Nunbers above line indicate inch ecale for GF, nuBbera below line for P8, 



Pifure 

IPC type eroeepiet of the leecaiaf trlale of atibjaet 0F» Uluitvaciog 
ebe oethol of plettlog ebeie oenlr oeaeaoelve g t eopnw e e io cteated ae 
a data polat, itoUaa tlia celetiv^ly larger d* (hlibar diacctaleahilUy) 
hare th«i la fig* b* Seale aloag tOC eerve to fadiaa. 


' 449 - 



